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Summary. This paper proposes real-time sequential convex programming (RTSCP), a method 
for solving a sequence of nonlinear optimization problems depending on an online parameter. 
We provide a contraction estimate for the proposed method and, as a byproduct, a new proof 
of the local convergence of sequential convex programming. The approach is illustrated by an 
example where RTSCP is applied to nonlinear model predictive control. 
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1 Introduction and motivation 

Consider a parametric optimization problem of the form: 
f min c T x 

— < x HO 

\ s.t. g{x) + M£ = 0, x e n, 

^ where x, c <G R™, g : R™ -> R m is a nonlinear function, fl C R" is a convex set, 

the parameter £ belongs to a given set F C R p , and M £ R_ mx P j s a given matrix. 
This paper deals with the efficient calculation of approximate solutions to a se- 
C^) quence of problems of the form P(£) where the parameter £ is varying slowly. In 

jy-^ other words, for a sequence {£fc}fc>i such that ||M(£/j + i — ^)\\ is small, we want to 

solve problem P(£fc) in an efficient way without requiring too much accuracy in the 
t-H result. 

In practice, sequences of problems of the form P(£) can be solved in the frame- 
work of nonlinear model predictive control (MPC). MPC is an optimal control tech- 
nique which avoids computing an optimal control law in a feedback form, which is 
often a numerically intractable problem. A popular way of solving the optimization 
problem to calculate the control sequence is using either interior point methods [1] 
or sequential quadratic programming (SQP) [2, 3, 9]. A drawback of using SQP is 
that this method may require several iterations before convergence and therefore the 
computation time may be too large for a real-time implementation. A solution to this 
problem was proposed in [6], where the real-time iteration (RTI) technique was in- 
troduced. Extensions to the original idea and some theoretical results are reported in 
[5, 7, 8]. Similar nonlinear MPC algorithms are proposed in [10, 13]. RTI is based 
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on the observation that for several practical applications of nonlinear MPC, the data 
of two successive optimization problems to be solved in the MPC loop is numeri- 
cally close. In particular, if we express these optimization problems in the form P(£)> 
the parameter £ usually represents the current state of the system, which, for most 
applications, doesn't change significantly in two successive measurements. The RTI 
technique consists of performing only the first step of the usual SQP algorithm which 
is initialized using the solution calculated in the previous MPC iteration. 

Contribution. Before stating the main contributions of the paper we need to outline 
the (full-step) sequential convex programming (SCP) algorithm framework applied 
to problem P(£) for a given value of the parameter £: 

1. Choose a starting point x° £ Q and set j := 0. 

2. Solve the convex approximation of P(£fc): 



to obtain a solution x' J+1 , where g'(-) is the Jacobian matrix of g(-). 
3. If the stopping criterion is satisfied then: STOP. Otherwise, set j := j + 1 and 
go back to Step 2. 

The real-time sequential convex programming (RTSCP) method proposed in this 
paper combines the RTI technique and the SCP algorithm: instead of solving with 
SCP every P(£fc) to full accuracy, RTSCP solves only one convex approximation 
Pcvx(£ fe_1 ; 6c) using as a linearization point x k ~ 1 , which is the approximate solution 
of P(£/j_i) calculated at the previous iteration. Therefore, RTSCP solves a sequence 
of convex problems corresponding to the different problems P(£fc). This method is 
suitable for the problems that contain a general convex substructure such as nons- 
mooth convex cost, second order or semidefinte cone constraints which may not be 
convenient for SQP methods. 

In this paper we provide a contraction estimate for RTSCP which can be inter- 
preted in the following way: if the linearization of the first problem P(£o) is close 
enough to the solution of the problem and the quantity ||M(£fc+i — £fc)ll i s not t0 ° 
big (which is the case for many problems arising from nonlinear MPC), RTSCP pro- 
vides a sequence of good approximations of the sequence of optimal solutions of 
the problems P(Cfc)- As a byproduct of this result, we obtain a new proof of local 
convergence for the SCP algorithm. 

The paper is organized as follows. Section 2 proposes a description of the RTSCP 
algorithm. Section 3 proves the contraction estimate for the RTSCP method. The last 
section shows an application of the RTSCP method to nonlinear MPC. 



As mentioned in the previous section, SCP solves a possibly nonconvex optimization 
problem by solving a sequence of convex subproblems which approximate the orig- 
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inal problem locally. In this section, we combine RTI and SCP to obtain the RTSCP 
method. The method consists of the following steps: 

Initialization. Find an initial value £1 € r, choose a starting point x° E f2 
and compute the information needed at the first iteration such as derivatives, 

dependent variables, Set k := 1. 

Iteration. 

1. Solve P cvx (x k ^ 1 ; £ k ) (see Section 3) to obtain a solution x k . 

2. Determine a new parameter £k+i e r, update (or recompute) the information 
needed for the next step. Set k := k + 1 and go back to Step 1. 

One of the main tasks of the RTSCP method is to solve the convex subproblem 
Pcvx(a;' c_1 ; 6c) at eacn iteration. This work can be done by either implementing an 
optimization method which exploits the problem structure or relying on one of the 
many efficient software tools available nowadays. 

Remark 1. In the RTSCP method, a starting point x° in Q is required. It can be any 
point in Q. But as we will show later [Theorem 1], if we choose x° close to the 
true solution of P(£o) and ||M(£i — £o)|| is sufficiently small, then the solution a; 1 of 
Pcvx(^°, £i) is still close to the true solution of P(£i). Therefore, in practice, problem 
P(£o) can be solved approximately to get a starting point x°. 

Remark 2. Problem P(£) has a linear cost function. However, RTSCP can deal di- 
rectly with the problems where the cost function f(x) is convex. If the cost function 
is quadratic and ft is a polyhedral set then the RTSCP method collapses to the real- 
time iteration of a Gauss-Newton method (see, e.g. [4]). 

Remark 3. In MPC, the parameter £ is usually the value of the state variables of a 
dynamic system at the current time t. In this case, £ is measured at each sample time 
based on the real-world dynamic system (see example in Section 4). 



3 RTSCP contraction estimate 

The KKT conditions of problem P(£) can be written as 

QEc + g'{x) T \ + N n {x) 
= g{x) + M£, 

where N n (x) := {u e R n | u T (v - x) > 0, Vw e J?} if x e n and N n (x) := 
if x $l fi, is the normal cone of Q at x, and A is a Lagrange multiplier associated 
with g. Note that the constraint x e fi is implicitly included in the first line of (1). 
A pair z(£) := (x(£), A(£)) satisfying (1) is called a KKT point and x(£) is called a 
stationary point of P(£). We denote by A(£) the set of KKT points at £. 

In the sequel, we use z for a pair (x, A), z k is a KKT point of P(£) at and z k is 
a KKT point of P cvx (a; fe ; £fc+i) (defined below) at £,k+i f° r k > 0. The symbols || • | 
and || • || p stand for the L 2 -norm and the Frobenius norm, respectively. 
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Now, let us define ip(z; £) := (° t f ^ £\ and if := J? x R m , then the KKT 

V w + M £ / 

system (1) can be expressed as a parametric generalized equation [11]: 

oe¥>(*;0 + JM*), (2) 

where Nk{z) is the normal cone of if at z. 

Let x fe e J? be a solution of P C vx(x k ~ 1 ; £fc) at tne A: -iteration of RTSCP. We con- 
sider the following parametric convex subproblem at Step 1 of the RTSCP algorithm: 

min c T x 

si g'{x k )(x-x k )+g(x k ) + M(, k+1 = 0, P C vx(^ fe ; 

If we define ^;^ fe+ i) := ( g( ^) + ^^.^ + MCfe+1 ) then the 

KKT condition for P CV x(£ fe , Cfc+i) can also be represented as a parametric general- 
ized equation: 

0e <p(z;x k ,Z k+1 )+N K (z), (3) 

where r\ k := (x fc , £fc+i) plays a role of parameter. Suppose that the Slater constraint 
qualification condition holds for problem P CV x(^ fc ; £fc+i)> i- e - : 

ri(rt) n {x : g(x k ) + g'(x k )(x - x k ) + M£ k+1 = 0} ^ 0, 

where ri(i?) is the set of the relative interior points of fi. Then by convexity of f2, a 
point z k+1 = (x k+1 ,\ k+1 ) is a KKT point of the subproblem P cvx (a; fe ; 6c+i) if and 
only if x k+1 is a solution of P cvx (x k ; Cfe+i) with a corresponding multiplier X k+1 . 
For a given KKT point z k € A(£k) of P(£fc), we define a set-valued mapping: 

L(«;0:=^;jc fc ,0 + ^K-W, (4) 

and L~ 1 (8; £) := {z e R" +m : 5 € L(z; £)} for <5 € R" +m is its inverse mapping. 
Note that e £(>; is indeed the KKT condition of P cvx (x k ; £)■ For each fc > 0, 
we make the following assumptions: 

(Al) The set of the KKT points Aq := A(£o) is nonempty. 

(A2) The function g is twice continuously differentiable on its domain. 

(A3) There exist a neighborhood Wo C R™+ m of the origin and a neighborhood 

N Z k of z k such that for each 8 G Nq, ?pk{<>) '■= Nz k ^I j ~ 1 (S;^) is single-valued 

and Lipschitz continuous on J\f with a Lipschitz constant 7 > 0. 

(A4) There exists a constant < k < I/7 such that ||.E g (z fc )||jr < k, where 

:=££i\*VW)- 
Assumptions (Al) and (A2) are standard in optimization, while Assumption (A3) 
is related to the strong regularity concept introduced by Robinson [11] for the 
parametric generalized equations of the form (2). It is important to note that the 
strong regularity assumption follows from the strong second order sufficient opti- 
mality in nonlinear programming when the constraint qualification condition (LICQ) 
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holds [11] [Theorem 4.1]. In this paper, instead of the generalized linear mapping 

Lr{z\ £) :— <p(z k ; £) + ip'(z k )(z — z k ) + N^(z) used in [11] to define strong reg- 
ularity, in Assumption (A3) we use a similar form L(z;£) = <p(z k \£) + D(z k )(z — 
z k ) + N K (z), where 

g'{x k ) T ~ 
g'{x k ) ■ 

These expressions are different from each other only at the left-top corner E g (z k ), 
the Hessian of the Lagrange function. Assumption (A3) corresponds to the stan- 
dard strong regularity assumption (in the sense of Robinson [1 1]) of the subproblem 
Pcvx(a ;fc ; Cfc+i) at tr, e point z k , a KKT point of (2) at £ = £ k . 

Assumption (A4) implies that either the function g should be "weakly nonlinear" 
(small second derivatives) in a neighborhood of a stationary point or the correspond- 
ing Langrage multipliers are sufficiently small in this neighborhood. The latter case 
occurs if the optimal value of P(£) depends only weakly on perturbations of the 
nonlinear constraint g(x) + M£ = 0. 

Theorem 1 (Contraction Theorem). Suppose that Assumptions (A1)-(A4) are sat- 
isfied. Then there exist neighborhoods J\f T of £ k , Af p ofz k and a single-valued func- 
tion z : Af T — > M p such that for all £,k+i € A/" T , z k+1 := z(£ k+ i) is the unique KKT 
point of P{£k+i) inAfp with respect to parameter (i.e. A(£k+i) 7^ Moreover, 
for any £k+l G ■N't- z k <= N p we have 

\\z k+1 - z k+1 \\ <u k \\z k -z k \\+c k \\M(S k+1 -Z k )\\, (5) 

where u k £ (0, 1), c k > are constant, and z k+1 is a KKT point ofP cvx (x k ; ). 
Proof. The proof is organized in two parts and step by step. The first part proves 
A k '■= A(£ k ) 7^ for all k > by induction and estimates the norm ||z fe+1 — z \\. 
The second part proves the inequality (5). 

lz(£) ~fc+i 

[1]: ||** -2*|| 
[2] : ||z fc+1 - 2 fe+1 || 
m:\\z k + 1 -i k \\ 
m--Uk+l-tk\\ 



j j | ; a = | I 

Fig. 1. The approximate sequence {z fe }fc along the manifold z(-) of the KKT points. 

Part 1: For k = 0, A ^ by Assumption (Al). Suppose that A k ^ for fc > 0, 

we will show that A k+ i ^ 0. We divide the proof into four steps. 

Step 1.1. We first provide the following estimations. Take any z k £ A k . We define 



V '{z k ) = 



E g (z k ) g'(x k ) T 
g'(x k ) 



and D(z k ) = 




r k (z; £) := <^(z; a; , £ fe ) - <y9(z; £). 



(6) 
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Since < 1 by (A4), we can choose e > sufficiently small such that + 
5y/3^e < 1. By the choice of e, we also have c := n + V3e € (0, 1/7). Since g 
is twice continuously differentiable, there exist neighborhoods J\f T C A/j fe of and 
N p C A/" 2 fc of a radius p > centered at z fc such that: r k (z;t) e A/o, ||7? g (z) — 
< e, ||£ fl (*) - ^(^ fe )||F < e, \\g'{x) - g'(x k )\\ F < e and \\g'{x) - 
g'(x k )\\ F < e for all z e N p . 

Next, we shrink the neighborhood M T of £fc, if necessary, such that: 

||M(^-a)|| <p(l-c )/7- (7) 

Step 1.2. For any z, z' e A/" p , we now estimate ||rfc(z; £) — r k (z'; £)||. From (6) we 
have 

r k (z;0- r k{z';Q = <p(z;x k ,t k )-ip(z'-,x k ,£ k )-ip{z;t)+v{z';t) 

,1 ( 8 ) 
= / B(z t ;5 fc )(z'-z)dt, 
Jo 

where z t := z + t(z' — z) e A/" p and 
B(z;i) 



7? s (z) 3 '(z)^ 
</(*)-</(£) 

Using the estimations of 75 9 and </ at 5fe/? 7.7, it follows from (9) that 



(9) 



\\B(z t -x k )\\ < \\E g (z k )\\ F + [\\E g (z t ) E g (z k )\\ F + 2\\g'{x t ) - g 1 {z k )f F } 1/2 
< k + v 3e = cq. 

Substituting (10) into (8), we get 

\\r k (z;0-r k (z';0\\ <c \\z-z'\\. (11) 

Step 1.3. Let us define $t(z) := A4* n L(r k (z; £); Next, we show that <£j (•) is 
a contraction self-mapping onto N p and then show that A k+ \ ^ 0. 

Indeed, since r k (z; £) e A/o, applying (A3) and (11), for any z, z' <G Af p , one has 

||^(z)-^(z')|| <l\\r k (z;0-r k (z';m < ic \\z - z'\\. (12) 

Since 7C0 G (0, 1) (see Sfe/? 7.7), we conclude that ^(-) is a contraction mapping 
on Afp. Moreover, since z k — M^k n L^ 1 (0; it follows from (A3) and (7) that 

\\Mz k ) - z k \\ < 7l|r fe (z fc ;0ll - l\\M({ - 6)11 < (1 - jc )p. 

Combining the last inequality, (12) and noting that ||z — z k \\ < p we obtain 

||^(z) - z k \\ < \\$ € (z) $dz k )\\ + \\^(-z k ) z k \\ < p, 

which proves <P(. is a self-mapping onto Af p . Consequently, for any £ k +i € A/" T , ^£ fc+ i 
possesses a unique fixed point z k+1 in J\f p by virtue of the contraction principle. This 
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statement is equivalent to z k+1 is a KKT point of P(£ fc+1 ), i.e. z k+1 e A(S >k+ i). 
Hence, A k+1 ^ 0. 

Step 1.4. Finally, we estimate \\z k+1 — z k \\. From the properties of we have 

\\z k + 1 -z\\<(l-c 0l )- 1 \\^ k+1 (z)-z\\, VzeA/- p . (13) 
Using this inequality with z = z k and noting that z k — <^ fc (z k ), we have 

- z k \\ < (1 - co^WS^Az) d4) 

Since \\r k (z k ;£ k ) - r k (z k ; ^ k+1 )\\ = ||M(£ fe+ i - £ fe )||, applying again (A3), it fol- 
lows from (14) that 

n^+i-^ii <(i- Co7 )-i 7 iiM(e fe+ i-a)ii- d5) 

Part 2: Let us define the residual from (p{z\ x k , £h+i) t0 xk , Cfe+i) as: 

S(z; x k ,£ k+1 ) := $>(z; x k , £ k+1 ) - <p{z; x k , £ fe+1 ). (16) 
Step 2.1. We first provide an estimation for \\5(z; x ,£ k +i)\\. From (16) we have 

5(z;x k ,£ k+1 ) = [ip(z; x k £ k+1 ) - tp(z k ;£ k+1 )] - [ip(z; £ fe+1 ) - (p(z k ; £ k +i)] 
- [tf>{z\x k Ak+i) - tp(z k ;£ k+1 )] + [<p(z;€ k +i) - </?0 fc ; 6c+i)] 

= f B(z k ;x k )(z- z k )dt- [ B{z k ;x k ){z-z k )dt (17) 
Jo Jo 

= f[B(z k :x k )-B(z k ;x k )] (z - z k )dt- [B(z k ;x k )(z k - z k )dt, 
Jo Jo 

where z k := z k +t(z — z k ), z k := z k +t(z — z k ) and B is defined by (9). Using the 
definition of and the estimations of E g and g' at Step 1.1, it is easy to show that 



\\B(z k ;x k )~B(z k ;x k )\\ < [\\E g (z^-E g (z k )\\ F +2\\g'(x k ) - g'(x k ) nFi 



,2 1 1/2 

(18) 

+ [\\E g (z^-E g (z k )\\ F +2\\g'(x k ) - g> (x k )\\ F ] 1/2 < 2V3e. 



Similar to (10), the quantity B(z k ; x k ) is estimated by 

\\B{z k ; x k )\\ < K + V3e. (19) 

Substituting (18) and (19) into (17), we obtain an estimation for \\S(z; x k , £fc+i)|| as 

\\5(z;x k ^ k+1 )\\ < ( K + V3s)\\z k -z k \\ +2VSe\\z-z k \\. (20) 
Step 2.2. We finally prove the inequality (5). Suppose that z k+1 is a KKT point of 
Pcvx( a;fe ; £fc+i)> we nave G ip(z k+1 ; x k , S, k+ i) + N K (z k+1 ). This inclusion implies 
5{z k+1 -x k ^ k+1 ) £ ^(z fc + 1 ;5 fc ,a+i)+iV i f(z fc + 1 ) = L(z fc+1 ; 6+i ) by the defini- 
tion (16) of S(z k+1 ;x k , £k+i). On the other hand, since £ (p{z k ; x k , £ k )+N K (z k ), 
which is equivalent to S\ := M(£ k+ i — £ k ) £ L(z k ; £/s+i), applying (A3) we get 
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\\z k+1 -z k \\ < 1 \\d(z k+1 ;x k ^ k+1 )-5 1 \\ 

< 7 P(z fc+1 ;x fe ,6 + i)||+7l|M(a +1 -6)l|. 
Combining this inequality and (20) with z = z k+1 to obtain 

\\z k+1 -z k \\ < 7 ( K +y3 e )||z fe -z fc ||+2y3 7e ||z fe+1 -z fc ||+ 7 ||M(6 + i-a)l|.(21) 
Using the triangular inequality, after a simple arrangement, (21) implies 



|zfe+ i _ < 7(« + 3V3e) ||zfc _ _ fe|| + l + 2^ 7£ || _ fc+1 _ _ fe| 

1 - 2\/3 7 £ 1 — 2v3 7 e 

+ I ^l|M(6 +1 -a)l|. 



(22) 



Now, let us define u k := ^gg) , c fc := [^±i + x ] _ By the choice 

of e at Step 1.1, we can easily check that uj k e (0, 1) and c k > 0. Substituting (15) 
into (22) and using the definitions of uj k and c k , we obtain 

l^fc+i _ _ fc+ i|| < wfe||zfc _ _ fc| | + Cfe || M(a+1 _ 

which proves (5). The theorem is proved. □ 

If r ee {£} then the RTSCP method collapses to the full-step SCP method de- 
scribed in Section 1. Without loss of generality, we can assume that £ fe = for all 
k > 0. The following corollary immediately follows from Theorem 1 . 

Corollary 1. Suppose that jz^ } J>1 is the sequence of the KKT points ofP cvx (x : '~ 1 ; 0) 
generated by the SCP method described in Section 1 and that the assumptions of 
Theorem 1 hold for £ k = 0. Then 

\W +1 -z\\ <w\\!P-z\\, Vj>0, (23) 

where u> G (0, 1) is the contraction factor. Consequently, this sequence converges 
linearly to a KKT point z ofP(0). 



4 Numerical example: control of an underactuated hovercraft 

In this section we apply RTSCP to the control of an underactuated hovercraft. We 
use the same model as in [12], which is characterized by the following differential 
equations: 

my\(t) = (ui(t) + u 2 (t)) cos(0), 
< my 2 (t) = («i(t) + u 2 {t)) sin(0), (24) 
J6(t)=r{u 1 {t)-u 2 {t)) 1 

where y(t) = (yi(t), y 2 (t)) T is the coordinate of the center of mass of the hovercraft 
(see Fig. 2); 6{t) represents the direction of the hovercraft; u\ (t) and u 2 (t) are the fan 
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Fig. 2. RC hovercraft and its model [12]. 

thrusts; m and / are the mass and moment of inertia of the hovercraft, respectively; 
and r is the distance between the central axis of the hovercraft and the fans. 

The problem considered is to drive the hovercraft from its initial position to the 
final parking position corresponding to the origin of the state space while respecting 
the constraints 

u < m{t) <u, u< u 2 (t) <u, y 1 < yx{t) < y 1 , y_ 2 < y 2 (t) < y 2 . (25) 

To formulate this problem so that we can use the proposed method, we discretize the 
dynamics of the system using the Euler discretization scheme. After introducing a 
new state variable £ :— (yi,y 2 , 0, yi, 2/2, &) T and a control variable u :— (ui,u 2 ) T , 
we can formulate the following optimal control problem: 

N-l 

min Yl [IIUq + KH*]+II6H|I 

Uq,...,un'— i n— u 

s.t. Co - 1 ( 26 > 

= 0(£ni«n) Vn = 0, . . . , N - 1, 

(£o,---,£n,u ,...,u N -i) e O, 

where </>(■, ■) represents the discretized dynamics and the constraint set Q can be 
easily deduced from (25). By introducing a slack variable s and using the convex 
constraint: 

N-l 

s>J2 PIUq + IKIIfl] + ll^lll. (27) 

n=0 

we can transform (26) into P(^) of a variable x :— (s, £q, . . . , Uq , . . . , uJ f _ 1 ) T 
and the objective function c T x = s. Note that £ is an online parameter. It plays the 
role of £fc in the RTSCP algorithm along the moving horizon (see Section 2). 

We implemented the RTSCP algorithm using a primal-dual interior point method 
for solving the convex subproblem P CV x(^ fc_1 ; We performed a simulation us- 
ing the same data as in [12]: m = 0.974kg, / = 0.0125kg • m 2 , r = 0.0485m, 
u = -0.121N, u = 0.342N,y 1 = y 2 = -2m, y x = y 2 = 2m, Q = 
diag(5, 10,0.1,1,1,0.01), S = diag(5, 15, 0.05, 1, 1,0.01), R = diag(0.01, 0.01) 
and the initial condition £ = C(0) = (-0.38, 0.30, 0.052, 0.0092, -0.0053, 0.002) T . 

Figure 3 shows the results of the simulation where a sampling time of At = 
0.05s and N — 15 are used. The stopping condition used for the simulation is 
\\y{t)\\ < 0.01. 
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-0.4 -0.3 -0.2 -0.1 2 4 6 8 

k - axis (n) Tim B [*] 



Fig. 3. Trajectory of the hovercraft after t = 9.5s (left) and control input profile (right). 
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